Hi @wxgeorge we are currently finishing a refactoring of Inference Providers integration code in #1315, this should be merged soon, but we will need to rewrite part of your implementation (should be even simpler to integrate), will ping again after it's been merged.

Hi @wxgeorge,
We've merged a refactoring for Inference Provider integration into main, which should make adding new providers much easier. Could you merge main into your branch and update your PR accordingly? it should be relatively straightforward with the new structure:
1 - You have to update the PROVIDERS mapping here: inference/src/lib/getProviderHelper.ts#L49 and add featherless-ai (let's ensure we respect the alphabetical order) :

import * as FeatherlessAI from "../providers/featherless-ai";
...
export const PROVIDERS: Record<InferenceProvider, Partial<Record<InferenceTask, TaskProviderHelper>>> = {
	...
	"featherless-ai": {
		"conversational": new FeatherlessAI.FeatherlessAIConversationalTask(),
		"text-generation": new FeatherlessAI.FeatherlessAITextGenerationTask(),
	},
        ...

2 - Update packages/inference/src/providers/featherless-ai.ts to implement the two classes FeatherlessAIConversationalTask and FeatherlessAITextGenerationTask that inherit from BaseConversationalTask and BaseTextGenerationTask respectively:

import { BaseConversationalTask, BaseTextGenerationTask } from "./providerHelper";

const FEATHERLESS_API_BASE_URL = "https://api.featherless.ai";

export class FeatherlessAIConversationalTask extends BaseConversationalTask {
	constructor() {
		super("featherless-ai", FEATHERLESS_API_BASE_URL);
	}
}

export class FeatherlessAITextGenerationTask extends BaseTextGenerationTask {
	constructor() {
		super("featherless-ai", FEATHERLESS_API_BASE_URL);
	}
}

and that's it :) let us know if you need any help! you can find more details in the documentation here : https://huggingface.co/docs/inference-providers/register-as-a-provider#2-js-client-integration

(sorry for the moving parts @wxgeorge – we can help move this PR over the finish line if needed)

(sorry for the moving parts @wxgeorge – we can help move this PR over the finish line if needed)

all good @julien-c

@julien-c @hanouticelina - updated!

@SBrandeis - thanks for the feedback. I think I've covered them all!

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.